Data Forensics in Diffusion Models: A Systematic Analysis of Membership Privacy

In recent years, diffusion models have achieved tremendous success in the field of image generation, becoming the stateof-the-art technology for AI-based image processing applications. Despite the numerous benefits brought by recent advances in diffusion models, there are also concerns about their potential misuse, specifically in terms of privacy breaches and intellectual property infringement. In particular, some of their unique characteristics open up new attack surfaces when considering the real-world deployment of such models. With a thorough investigation of the attack vectors, we develop a systematic analysis of membership inference attacks on diffusion models and propose novel attack methods tailored to each attack scenario specifically relevant to diffusion models. Our approach exploits easily obtainable quantities and is highly effective, achieving near-perfect attack performance (>0.9 AUCROC) in realistic scenarios. Our extensive experiments demonstrate the effectiveness of our method, highlighting the importance of considering privacy and intellectual property risks when using diffusion models in image generation tasks

Flow-Attention-based Spatio-Temporal Aggregation Network for 3D Mask Detection

Anti-spoofing detection has become a necessity for face recognition systems due to the security threat posed by spoofing attacks. Despite great success in traditional attacks, most deep-learning-based methods perform poorly in 3D masks, which can highly simulate real faces in appearance and structure, suffering generalizability insufficiency while focusing only on the spatial domain with single frame input. This has been mitigated by the recent introduction of a biomedical technology called rPPG (remote photoplethysmography). However, rPPG-based methods are sensitive to noisy interference and require at least one second (> 25 frames) of observation time, which induces high computational overhead. To address these challenges, we propose a novel 3D mask detection framework, called FASTEN (Flow-Attention-based Spatio-Temporal aggrEgation Network). We tailor the network for focusing more on fine-grained details in large movements, which can eliminate redundant spatio-temporal feature interference and quickly capture splicing traces of 3D masks in fewer frames. Our proposed network contains three key modules: 1) a facial optical flow network to obtain non-RGB inter-frame flow information; 2) flow attention to assign different significance to each frame; 3) spatio-temporal aggregation to aggregate high-level spatial features and temporal transition features. Through extensive experiments, FASTEN only requires five frames of input and outperforms eight competitors for both intra-dataset and cross-dataset evaluations in terms of multiple detection metrics. Moreover, FASTEN has been deployed in real-world mobile devices for practical 3D mask detection.Comment: 13 pages, 5 figures. Accepted to NeurIPS 202

LUNA: A Model-Based Universal Analysis Framework for Large Language Models

Over the past decade, Artificial Intelligence (AI) has had great success recently and is being used in a wide range of academic and industrial fields. More recently, LLMs have made rapid advancements that have propelled AI to a new level, enabling even more diverse applications and industrial domains with intelligence, particularly in areas like software engineering and natural language processing. Nevertheless, a number of emerging trustworthiness concerns and issues exhibited in LLMs have already recently received much attention, without properly solving which the widespread adoption of LLMs could be greatly hindered in practice. The distinctive characteristics of LLMs, such as the self-attention mechanism, extremely large model scale, and autoregressive generation schema, differ from classic AI software based on CNNs and RNNs and present new challenges for quality analysis. Up to the present, it still lacks universal and systematic analysis techniques for LLMs despite the urgent industrial demand. Towards bridging this gap, we initiate an early exploratory study and propose a universal analysis framework for LLMs, LUNA, designed to be general and extensible, to enable versatile analysis of LLMs from multiple quality perspectives in a human-interpretable manner. In particular, we first leverage the data from desired trustworthiness perspectives to construct an abstract model as an auxiliary analysis asset, which is empowered by various abstract model construction methods. To assess the quality of the abstract model, we collect and define a number of evaluation metrics, aiming at both abstract model level and the semantics level. Then, the semantics, which is the degree of satisfaction of the LLM w.r.t. the trustworthiness perspective, is bound to and enriches the abstract model with semantics, which enables more detailed analysis applications for diverse purposes.Comment: 44 pages, 9 figure

Event-triggered consensus control for discrete-time stochastic multi-agent systems: The input-to-state stability in probability

This paper is concerned with the event-triggered consensus control problem for a class of discrete-time stochastic multi-agent systems with state-dependent noises. A novel definition of consensus in probability is proposed to better describe the dynamics of the consensus process of the addressed stochastic multiagent systems. The measurement output available for the controller is not only from the individual agent but also from its neighboring ones according to the given topology. An event-triggered mechanism is adopted with hope to reduce the communication burden, where the control input on each agent is updated only when a certain triggering condition is violated. The purpose of the problem under consideration is to design both the output feedback controller and the threshold of the triggering condition such that the closed-loop system achieves the desired consensus in probability. First of all, a theoretical framework is established for analyzing the so-called input-to-state stability in probability (ISSiP) for general discretetime nonlinear stochastic systems. Within such a theoretical framework, some sufficient conditions on event-triggered control protocol are derived under which the consensus in probability is reached. Furthermore, both the controller parameter and the triggering threshold are obtained in terms of the solution to certain matrix inequalities involving the topology information and the desired consensus probability. Finally, a simulation example is utilized to illustrate the usefulness of the proposed control protocol.Royal Society of the UK, the National Natural Science Foundation of China under Grants 61329301, 61203139 and 61473076, the Hujiang Foundation of China under Grants C14002 and D15009, the Shanghai Rising- Star Program of China under Grant 13QA1400100, the ShuGuang project of Shanghai Municipal Education Commission and Shanghai Education Development Foundation under Grant 13SG34, the Fundamental Research Funds for the Central Universities, DHU Distinguished Young Professor Program, and the Alexander von Humboldt Foundation of German

Evaluating Nanoparticles in Preclinical Research Using Microfluidic Systems

Nanoparticles (NPs) have found a wide range of applications in clinical therapeutic and diagnostic fields. However, currently most NPs are still in the preclinical evaluation phase with few approved for clinical use. Microfluidic systems can simulate dynamic fluid flows, chemical gradients, partitioning of multi-organs as well as local microenvironment controls, offering an efficient and cost-effective opportunity to fast screen NPs in physiologically relevant conditions. Here, in this review, we are focusing on summarizing key microfluidic platforms promising to mimic in vivo situations and test the performance of fabricated nanoparticles. Firstly, we summarize the key evaluation parameters of NPs which can affect their delivery efficacy, followed by highlighting the importance of microfluidic-based NP evaluation. Next, we will summarize main microfluidic systems effective in evaluating NP haemocompatibility, transport, uptake and toxicity, targeted accumulation and general efficacy respectively, and discuss the future directions for NP evaluation in microfluidic systems. The combination of nanoparticles and microfluidic technologies could greatly facilitate the development of drug delivery strategies and provide novel treatments and diagnostic techniques for clinically challenging diseases

DLRW: Dual-Link Weight Random Walk Model for Aquaculture Boundary Extraction by Single-Polarized SAR Imagery

Coastal aquaculture is undertaken in shallow and usually sheltered waters along the coast, delineated by aquaculture ponds. Illegal usage of coastal aquaculture can lead to conflicts with local communities and environmental problems. Thus, it is necessary to extract the aquaculture boundary to monitor the expansion of coastal aquaculture to the sea. However, it is challenging for most existing algorithms to extract the aquaculture boundary for synthetic aperture radar (SAR) images under a high incident angle (>30 degree) with horizontal transmitted and received (HH) or vertical transmitted and received (VV) polarization. The difficulties come from the following: (1) seawater can be seen on both sides of such boundaries, (2) the contrast of such boundaries is uneven, and (3) the backscattering coefficients in some parts of such boundaries are low. In this paper, a novel dual-link weight random walk (DLRW)-based method is proposed to extract such boundaries. The proposed DLRW is composed of an automatic seed points generation strategy, and the establishment and solving of a random walk model with the dual-link weight. By a coarse-to-fine procedure, DLRW is used to extract the aquaculture boundaries in the whole imagery. Sentinel-1 and GF-3 images in Dalian and Liaodong Bay, China have been used in experiments. Mean offset (MO), root mean square error (RMSE), Overlapped, accuracy within one pixel (WOP), and accuracy within two pixels (WTP) have been used to evaluate the performance with existing methods. Experimental results have demonstrated the proposed DLRW-based method outperforms existing methods in the extraction on aquaculture boundaries. Under the low tide, the DLRW-based method is better than the other two methods with MO, RMSE, Overlapped, WOP, and WTP by at least 5.75 pixels, 10.43 pixels, 2.88%, 11.09%, and 18.04%, respectively. Under the high tide, the DLRW-based method is superior to the other two methods with MO, RMSE, and WTP by at least 3.8 pixels, 10.5 pixels, and 6.3%. In addition, the proposed DLRW-based method has a good ability to extract the shoreline with bedrock, ports, and silt. Therefore, the proposed DLRW-based method can be of great value to coastal aquaculture monitoring, coastal mapping, and other coastal applications

Microbial community structure and diversity within hypersaline Keke Salt Lake environments

Keke Salt Lake is located in the Qaidamu Basin of China, and is a unique magnesium sulfate-subtype hypersaline lake that exhibits a halite domain ecosystem, yet its microbial diversity has remained unstudied. Here, the microbial community structure and diversity was investigated via high-throughput sequencing of the V3-V5 regions of 16S rRNA genes. A high diversity of OTUs were detected for Bacteria and Archaea (734 and 747, respectively) which comprised 21 phyla, 43 classes, and 201 genera of Bacteria and 4 phyla, 4 classes, and 39 genera of Archaea. Salt-saturated samples were dominated by the bacterial genera Bacillus (51.52%–58.35% relative abundance), Lactococcus (9.52%–10.51%) and Oceanobacillus (8.82%–9.88%) within the Firmicutes phylum (74.81–80.99%) contrasting with other hypersaline lakes. The dominant Archaea belonged to the Halobacteriaceae family, and in particular, the abundant genera (>10% of communities) Halonotius, Halorubellus, Halapricum, Halorubrum and Natronomonas. Additionally, we report the presence of Nanohaloarchaeota and Woesearchaeota in Qinghai-Tibet Plateau lakes, which has not been previously documented. Total salinity (especially MgThe accepted manuscript in pdf format is listed with the files at the bottom of this page. The presentation of the authors' names and (or) special characters in the title of the manuscript may differ slightly between what is listed on this page and what is listed in the pdf file of the accepted manuscript; that in the pdf file of the accepted manuscript is what was submitted by the author